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FFS SEARCH AND EDIT PIPLINE SEPARATION 

FIELD OF THE INVENTION 
[0001] The present invention generally relates to the field of search engines, and 
particularly to fast flexible search and edit pipeline separation. 

BACKGROUND OF THE INVENTION 
[0002] Data communications is most often accomplished by sending a group of data in a 
packet, together with the address of the location for which the data is intended. For 
instance, a search for data may be accomplished by conducting a binary search based on 
the address or prefix where the data are retained, or stored, and the data returned in a 
packet to the requesting address. The search is conducted by a lookup procedure that 
matches the query address with the stored address. 

[0003] However, lookup procedures may be a major source of bottlenecks in high 
performance compilers and routes. Lookup techniques are used in various compilers 
such as compilers used in designing semiconductor and integrated circuit chips, and in 
network applications such as Internet address (URL) lookup in high performance data 
routers where large search tables or databases are employed. Searching large tables or 
databases may require increased time or hardware requirements, or both, resulting in 
more expensive systems in terms of increased search delays and larger memories. 
Problems associated with such lookups increase with the size of the table or database, 
may increase with the address length encountered, increase with traffic flow, and the 
introduction of higher speed links may result in a bottleneck. For example, with use of 
the next generation IPv6 protocol, which uses 128-bit addresses, such problems may 
increase as more numerous and longer addresses are encountered. 
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[0004] Additionally, in systems employing present search techniques, edit operations 
may interfere with search operations, thereby greatly affecting the efficiency and 
performance of the system as a whole. 

[0005] Therefore, it would be desirable to provide improved search engine architecture 
for efficient operation. 

SUMMARY OF THE INVENTION 
[0006] Accordingly, the present invention is directed to fast flexible search and edit 
pipeline separation. In a first aspect of the present invention, a system suitable for 
providing a search includes a central controller and at least one search engine. The 
central controller is suitable for implementing search and edit operations. The at least 
one search engine is communicatively coupled to the central controller. The central 
controller performs parallel execution of a search operation and an edit operation through 
utilization of the at least one search engine. 

[0007] In a second aspect of the present invention, a search engine suitable for providing 
a search includes a memory, a priority controller, an edit module, a search module and an 
address cache. The memory is suitable for storing electronic data and the priority 
controller is communicatively coupled to the memory. The edit module is 
communicatively coupled to the priority controller, the edit module configured to 
perform calculations for an edit operation. The search module is communicatively 
coupled to the priority controller, the search module configured to perform calculations 
for a search operation. The address cached is communicatively coupled to the memory 
and the priority controller, the address cache suitable for storing electronic data. The 
priority controller manages access to the memory by the edit module, search module and 
address cache. 
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[0008] In a third aspect of the present invention, a system suitable for providing a search 
includes a central controller and a plurality of search engines. The central controller is 
suitable for implementing search and edit operations and suitable from inputting and 
outputting external communications. The plurality of search engines are arranged in zero 
through k levels, wherein a k level search engine of the plurality of search engines is 
communicatively coupled to the central controller and a zero level search engine of the 
plurality of search engines is communicatively coupled to the central controller. The 
central controller performs parallel execution of a search operation and an edit operation 
through utilization of at least one of the plurality of search engines. 

[0009] It is to be understood that both the forgoing general description and the following 
detailed description are exemplary and explanatory only and are not restrictive of the 
invention as claimed. The accompanying drawings, which are incorporated in and 
constitute a part of the specification, illustrate an embodiment of the invention and 
together with the general description, serve to explain the principles of the invention. 



BRIEF DESCRIPTION OF THE DRAWINGS 
[0010] The numerous advantages of the present invention may be better understood by 
those skilled in the art by reference to the accompanying figures in which: 

[0011] FIG. 1 is a block diagram depicting an exemplary embodiment of the present 
invention wherein communication between search engine levels is shown; and 

[0012] FIG. 2 is a block diagram illustrating an exemplary embodiment of the present 
invention wherein the structure of one engine stage is shown. 
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DETAILED DESCRIPTION OF THE INVENTION 
[0013] Reference will now be made in detail to the presently preferred embodiments of 
the invention, examples of which are illustrated in the accompanying drawings. 

[0014] Referring generally now to FIGS. 1 through 2, exemplary embodiments of the 
present invention are shown. The present invention provides the ability to perform edit 
operations, such as insert and delete, without interrupting searches being performed at the 
same time. For instance, this invention may be applied to fast flexible search high speed 
lookup engines for perfect and longest prefix matches, such as the search engines 
described in United States Patent Application Number 09/678,313, titled "Fast Flexible 
Search Engine for Perfect Match" Attorney Docket Number 00-175, filed October 4, 
2000; and United States Patent Application Number 09/678,313, titled "Fast Flexible 
Search Engine for Longest Prefix Match" Attorney Docket Number 00-210, filed October 
4, 2000, which are herein incorporated by reference in their entirety, and is applicable for 
any search engine with similar pipeline structures, as well as other structures 
contemplated by a person of ordinary skill in the art without departing from the spirit and 
scope of the present invention. 

[0015] For example, a sorted binary search tree may be provided having a fixed number 
of levels, in which the bottom vertices contain keys and associated data. The hierarchy 
vertices or nodes may contain one key for each child vertex and a vertex address pointing 
to the vertex containing that key. The keys are arranged in a predetermined order, such 
as address order, across the vertices of each level such that a search into a given hierarchy 
vertex is directed into a specific group of keys. The search tree is structured so that all 
search paths are the same length. Nodes or vertices may be inserted and deleted at most 
levels, thereby maintaining the equal length to all search paths. The tree may employ 
perfect matching techniques which seek a perfect match between the input or query key 
and the key being sought. If a perfect match is not returned, the search reports a false 
return. 
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[0016] In some instances of longest prefix searching, the prefix may be any length, such 
as up to W-l, where W is the maximum length of an address. Since W=32 in IPv4 
Protocol and W=128 in IPv6 protocol, the prefix may be any length between 1 and 31 
bits in IPv4 protocol and between 1 and 127 bits in IPv6 Protocol. Thus, a vast number 
of variable-length prefixes may exist in both IPv4 and IPv6 protocols. The number of 
memory accesses required by traditional perfect match search of variable length prefixes 
increases with the number of prefixes. Consequently, the number of memory accesses 
may be large, thereby slowing the search process. One method utilized to address this 
problem is described in co-pending application titled "Fast Flexible Search Engine for 
Longest Prefix Match" referenced previously, which describes a system and method for 
establishing a single length for all prefixes and subprefixes, such as equal to the length of 
the addresses. 

[0017] Such improvements may be further utilized through implementation of the present 
invention. The present invention provides a protocol for search engine operation 
interaction, which allows the parallel execution of an uninterrupted search stream on one 
side and one of the edit operations, such as insert and delete, on the other side. 
Preferably, the execution latency of the search operation remains the same as without 
simultaneous edit operation. The search operation may start at any clock rate. 

[0018] Referring now to FIG. 1, an exemplary embodiment of the present invention is 
shown wherein an architecture and communication between search engine levels is 
shown. By employing the present invention, a pipeline architecture may be supplied that 
allows uninterrupted execution of search operations and an insert and delete operation. 
The present invention may be applied to a variety of search engines, and thus the present 
discussion will not differentiate the types of the search engine which may be employed, 
such as perfect, longest prefix match (the pipeline structure is the same for both cases) 
and like structures as contemplated by a person of ordinary skill in the art. 
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[0019] The engine 100 contains k+l=_numb_level level blocks 104, 106, 108 & 110 and 
a central controller 102. The number jnumbjevel is the depth of the search tree, such as 
a search tree utilized in perfect match search engine. The level index increases from 0 for 
the bottom tree level 110 to the maximal value k=(jiumbjevel-l) for the top 104. The 
top level 104 corresponds to the root tree vertex. Any two neighbor levels are connected 
in both directions. The central controller 102 is connected with the top 104 and bottom 
levels 110 in both directions too. The external pins 112 & 114 belong to the central 
controller 102. 

[0020] There are three sets of connections: one for the search 1 16, a second for the edit 
operation 118 and a third one for control of an address cache 120. In an embodiment, the 
search connections 116 progress in one direction: from the central controller 102 to the 
top level 104, from the top level 104 to the (k-l)-th level 106, from (k-l)-th level 106 to 
1-th level 108, from the 1-th level 108 to the bottom level 1 10, and from the bottom level 
1 10 to the central controller 102. 

[0021] The edit connections 118 may progress in both directions. The cache connections 
120 are similar to the search connections, but a signal is not provided from the bottom 
level to the central controller. The cache bus may be employed utilizing a single wire. 

[0022] The search bus may contain the following: (1) key for search; (2) address in 
memory of the next tree vertex; (3) degree of the tree vertex; (4) mask of subprefixes in 
the longest prefix match case; and like data as contemplated by a person of ordinary skill 
in the art. 

[0023] The connection from the bottom level 110 to the central controller 102 may 
include searched data too. The edit bus has the same field and a few control bits to 
specify commands from one engine level to another. 
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[0024] In contemplated embodiments, the execution time of edit operation is reciprocally 
proportional to the input search stream density. 

[0025] Referring now to FIG. 2, an embodiment of the present invention is shown 
wherein contents of an exemplary search engine 200 are described. Each engine stage 
104, 106, 108 & 1 10 (FIG. 1) may contain a separate processor and a memory 202. The 
memory stores vertices of the corresponding tree level. The processor has 4 main parts: a 
search module 204; an edit module 206; a memory address cache 210; and a priority 
controller 208. Connections between modules 202, 204, 206, 208 & 210 are shown in 
FIG. 2. 

[0026] The search module 204 performs calculations for the search operation. The 
search module 204 obtains input signals from similar search module of the upper 
neighbor (previous) level and sends output signals to the search module of the next level. 
For instance, a search module of the (K-l)-th engine level 106 may obtain output signals 
from the K-th engine level 104 (FIG. 1). The input of the top search module 104 may be 
obtained from the central controller 102. The output of the 0-th engine level 110 search 
module is provided to the central controller 102. 

[0027] The search module 204 communicates with the memory 202 through the priority 
controller 208. For instance, the search module 204 may send the address "A" and a 
control bit "R" to the priority controller 208, which may be 1 if a search is in an active 
state and zero otherwise. The search module 204 receives a data "DO" from the memory 
202. 

[0028] The edit module 206 performs calculations for insert and delete operations. The 
edit module has inputs and outputs from both neighboring levels. For instance, referring 
again to FIG. 1, the (K-l)-th engine level may send and receive data from both the k-th 



8 



LSI 01-956 



engine level 104 and the 1-th engine level 108. The top and bottom edit modules, as 
included in the k-th engine level 104 and 0-th engine level 110, have connections with 
the central controller 102. 

[0029] The edit module 206 connects with the level memory 202 through the memory 
controller (priority controller 208). The edit module 206 sends to the priority controller 
208 the address "A" and control bits "R" and "W'\ The bit "R" may be equal to 1, if edit 
module 206 tries to read from memory 202. The bit "W" is equal to 1 if edit module 206 
tries to write into the memory 202. The edit module 206 receives data "DO" from the 
memory 202 and sends data "DP to the memory 202. The edit module 206 may also 
receive signal "READY" from the priority controller 208. If the "READY" signal is 
equal to 1, the priority controller 208 allows the edit module 206 to access the memory 
202. 

[0030] The priority controller 208 has connections to the memory 202, cache module 
210, search module 204 and edit module 206. The priority controller 208 manages 
accessing by these modules 204, 206 & 210 to the memory. The cache module 210 may 
modify addresses to provide correct searches. 

[0031] A problem in separation of the search and edit operations is simultaneous memory 
access by both types of operations. The edit operation transforms memory content 
relatively slowly, level by level. Additionally, the search operation is correct only if the 
edit operation has finished. The present invention addresses these issues through the use 
of the priority controller 208. 

[0032] For instance, a search operation requires just read access to the memory. The edit 
operation needs read and write access to the memory. In a contemplated embodiment, 
the search operation has priority, and the priority controller 208 allows communication of 
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the edit module 206 with the memory 202 only in the case when search does not read the 
memory 202. 

[0033] In order to provide reliable and accurate access by the search operation to the 
memory 202, controller 208 may access an address cache module 210. For example, if 
an edit operation requests a read of memory address Al of the memory 202, the content 
of memory address Al is copied to a free address, A2, and pair (Al, A2) is stored in the 
cache 210, which may include small content addressable memory (CAM). The memory 
controller is looking for the search address A in the left side of the CAM. If it exists 
there, for example A = Al, it will be replaced by the right component of the 
corresponding CAM entry, i.e. A2. This guaranties that a search reads from the memory 
the same information as before the start of the edit operation. 

[0034] After the edit operation is finished, the cache may be cleared. To perform this 
procedure, the central controller may send a signal through the cache bus to the memory 
controllers. Signal synchronization with the search stream allows the system of the 
present invention to preserve correctness at this period of time. 

[0035] Referring again to FIG. 1, the central controller 102 communicates with the 
outside world. The central controller 102 receives external commands and transfers them 
to one of the pipelines: search 116 or edit 118. The central controller 102 controls the 
edit operation's execution and saves the current execution edit command and information 
associated with it, such as address, data and the like. The central controller 102 may 
utilize this information to produce the answer for the search operation. From a user point 
of view, all operations (search, insert, delete) execute in the order received. 

[0036] In an embodiment of the present invention, the central controller 102 rejects any 
edit operation issued before the current edit operation is finished. In the case of the insert 
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operation the associated data does not travel through the pipeline. The central controller 
102 sends it immediately to the bottom processor. 

[0037] It is believed that the system and method of the present invention and many of its 
attendant advantages will be understood by the forgoing description. It is also believed 
that it will be apparent that various changes may be made in the form, construction and 
arrangement of the components thereof without departing from the scope and spirit of the 
invention or without sacrificing all of its material advantages. The form herein before 
described being merely an explanatory embodiment thereof. It is the intention of the 
following claims to encompass and include such changes. 
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